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Abstract. The paper studies a closed queueing network containing two types of 
node. The first type (server station) is an infinite server queueing system, and the 
second type (client station) is a single server queueing system with autonomous 
service, i.e. every client station serves customers (units) only at random instants 
generated by strictly stationary and ergodic sequence of random variables. It is 
assumed that there are r server stations. At the initial time moment all units are 
distributed in the server stations, and the ith server station contains Ni units, i = 
1,2, ...,r, where all the values Ni are large numbers of the same order. The total 
number of client stations is equal to k. The expected times between departures in the 
client stations are small values of the order 0(N~ 1 ) (N = Ni +N2 + ... + N r ). After 
service completion in the ith server station a unit is transmitted to the jth client 
station with probability pij (j = 1, 2, k), and being served in the jth client station 
the unit returns to the ith server station. Under the assumption that only one of 
the client stations is a bottleneck node, i.e. the expected number of arrivals per time 
unit to the node is greater than the expected number of departures from that node, 
the paper derives the representation for non-stationary queue-length distributions 
in non-bottleneck client stations. 
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1. Introduction 



1.1. Description of the model and motivation 

We consider a closed queueing network containing two types of node. 
The first type (server station) is an infinite server queueing system with 
identical servers. There are r server stations. The second type (client 
station) is a single server queueing system with autonomous service, 
where customers (units) are served only at random instants generated 
by strictly stationary and ergodic sequence of random variables. 

Queueing systems with autonomous service were introduced and 
originally studied by Borovkov [4], [5]. Below we recall the definition 
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of the version of queueing system with autonomous service in the case 
when both arrival of customers and their service are ordinary (i.e. not 
batch), and all processes (arrival, departure etc.) start at 0. 

Let E(t) and S(t) be right continuous, having the left-limits, point 
processes, defined for all t > 0. Let E(t) describe an arrival process, 
and let S(t) describe a departure process. We say that the service 
mechanism is autonomous if the queue-length process Q(t) is defined 
by the equation 

Q(t) = E{t)- [ t l{Q(s-)>0}dS(s), 
Jo 

where 1(^4) denotes an indicator of event A, and the integral is under- 
stood in the sense of the Lebesgue-Stieltjes integral. For a more general 
definition of queueing systems with autonomous service, when arrivals 
and departures occur by batches see Borovkov [4], [5]. 

Along with r server stations there are k client stations. The depar- 
ture instants in the jth client station (j = 1,2, ...,k) are denoted ^i, 
£?>i + £i.2> + 0,2 + Cj',3>- • • where, as it was mentioned above, 

• each sequence {Cj,i,S,j,2, •••} forms a strictly stationary and ergodic 
sequence of random variables. 

The closed network contains N units. At the initial time moment 
they are distributed in the server stations, and the ith server station 
contains Ni units (N1+N2 + ...+N r = N). The service time of each unit 
of the ith server station is exponentially distributed random variable 
with the expectation Aj. After a service completion at the ith server 
station a unit is transmitted to the client station j with probability 
Pi,j > 0, Ylj=iPi,j = 1) an d then, after the service completion at the 
jth client station, the unit returns to the ith server station. Thus, the 
model of the network considered here is a model with multiple customer 
classes defined by r server and k client stations. 

Denote Xij = XiPij and (fijN)^ 1 = E^i. Then, the input rate to 
the jth client station is 

r 

and the traffic intensity 

In the following it will be assumed that 

• the series parameter N increases to infinity, and, as iV — > cxd, each 
fraction Ni/N converges to some positive number ccj. 
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Then client station j is called non-bottleneck station if, as N — > oo, 
the limiting value Qj = liniAr^oo Qj(N) is less than 1. Otherwise, the 
jth client station is called bottleneck station. 

It is assumed in the paper that 



• the first k — 1 client stations are non-bottleneck stations, while the 
kth client station is a bottleneck station. 



It was assumed above that 



the probabilities pij satisfy the following two conditions: pij > 

. T); _■ = 1 

3= 



and ELiPiJ = 1 



These two conditions define a general class of connections between 
the client and server stations. For example, if pij = for some indexes 
i, j, then there is no connection between the ith server station and the 
jth client station. Keeping in mind that according to the convention 
that the kth. client station is a bottleneck station, the behavior of queues 
in the non-bottleneck client stations essentially depends on topology of 
the network, that is on existing connections between the server and 
client stations. In order to clarify this, consider two different topologies 
of the network containing two server and four client stations. These 
two topologies are shown in Figures 1.1 and 1.2 below. 



In the network described in Figure 1.1 the probabilities pi s, pi 4, 
P2,i and ^2,2 are equal to 0, while the probabilities p\ t ±, pip, P2,3 and 
P2,4 are positive. Then four client stations are separated into two nonin- 
tersecting groups, and the network is decomposed into two subnetworks 
forming the simplest tree. The topology of the network looks as follows. 
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1 2 3 4 




Figure 1 .1 . Network with two server stations is 
decomposed into two subnetworks 



Another example of the network is described in Figure 1.2. In this 
network all the probabilities pij are strictly positive, and then the 
network can not be decomposed into subnetworks, and it forms a net. 
The topology of the network looks as follows. 
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Figure 1 .2. The network topology where all client 

stations are connected with all server stations 



It is clear that the case of the network described in Figure 1.1 is 
artificial rather than realistic: the considered network is explicitly sep- 
arated into two subnetworks. The analysis of that network is reduced 
to the same analysis of the network with one server. One of subnetwork 
has a bottleneck client station, other has non-bottleneck client stations 
only. The analysis of the network with only one server station (hub) 
and a number of client (satellite) stations has been done in Abramov 
[1], and earlier, in the case of Markovian network in Kogan and Liptser 
[16]. 
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The network topology described in Figure 1.2 is a topology where 
there are connections between all client stations and all server stations. 
The behavior of this network, as N — > oo, also has simple intuitive 
explanation and can be reduced to the case of the network studied in 
the earlier paper of Abramov [1]. In the following we will return to the 
explanation of that behavior. 

Now, speaking about the general network topology it is worth noting 
the following. The specific feature of the network, having a hub and 
several satellite stations, is that if there is a bottleneck node, then 
the behavior of queues in all non-bottleneck stations depends on the 
behavior of the queue in the bottleneck station. In the limiting case as 
N — > oo the dependence vanishes. However, the limiting non-stationary 
queue-length distributions in all non-bottleneck satellite stations are 
dependent of time t (see Abramov [1]). The behavior of the network 
containing several server and client stations is more complicated. For 
details see Sections 1.3 and 1.4. 

There is a large number of different applications for the queueing 
network with two types of node described above. Below we provide 
one of the possible motivation as a database distributed in r server 
stations. Then by unit we mean records of data or data units that 
can be called by users from the client stations. The action of user is 
to call and update a data unit. Being called by one client station the 
data unit becomes blocked and not accessible from other ones. After 
completion of the processing of the data unit the system unblocks it, 
and again the data unit becomes accessible for new actions. Note, that 
our assumption that the service mechanism is autonomous is one of 
possible generalizations of Markovian networks. Autonomous service 
mechanism is of interest for technologies of computer systems, where 
from time to time the system automatically looks up the queue in order 
to provide then the service for its units (messages, queries) waiting for 
their processing. 

1.2. The history of question and the goal of the paper 

The history of subject is very rich. There is a large number of papers 
in the queueing literature explicitly or implicitly related to the subject. 
A large number of papers study state-dependent and time-dependent 
queueing models, providing different approximations including diffusion 
and fluid approximations (e.g. Krylov and Liptser [22], Mandelbaum 
and Massey [26], Mandelbaum et al [27], Mandelbaum and Pats [28], 
[29], Chen and Mandelbaum [7], [8], Chao [6], Williams [35], [36], [37] 
and others). A state-dependent queueing model, where the arrival and 
service rates depend on the current workload of the system, can be 
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considered as a model for separated client station of computer network. 
The detailed asymptotic analysis of such systems by analytic methods 
is given in a number of papers of Knessl et al [10] - [14] etc. A number 
of papers study one server and one client stations only. Containing two 
types of node these system are closer to the considered system. Such 
systems have been studied in Krichagina et al [20], Krichagina and 
Puhalskii [21], Liptser [23] and other papers. Different models, closed 
to the considered model, have been also studied in Whitt [34], Knessl 
and Tier [15], Kogan et al [17], [18], Reiman and Simon [31] and others. 

Nevertheless, speaking about the history of subject we restrict our 
attention only with a small number of papers, having a close relation 
to the considered paper in some aspects as description of model, main 
goal of research and mathematical methods. Only the papers by Kogan 
and Liptser [16], Abramov [1], [2] will be discussed here. These three 
papers form a chronological chain of papers providing a comprehensive 
analysis of the queueing networks with one server station (hub) and a 
number of client stations (satellite nodes), where one of the satellite 
nodes is a bottleneck station. All these networks depend on the large 
parameter N - the number of tasks in the server, and, as N — > oo, the 
papers study the limiting non-stationary queue-length distribution in 
non-bottleneck satellite stations. The papers also provide the diffusion 
and fluid approximations (given under appropriate assumptions) for 
the queue-length in the bottleneck satellite station. The method of 
analysis in these papers is the theory of martingales, where in two 
of these three papers, Kogan and Liptser [16] and Abramov [1], the 
dominated method is the stochastic calculus, while the main method in 
Abramov [2] is the up- and down-crossings approach and the martingale 
techniques in discrete time. The part of the paper of Abramov [2], 
related to the bottleneck analysis, uses the stochastic calculus as well, 
but its application is related to the special examples rather than to the 
theory. Below we briefly discuss the part of the results related to the 
limiting non-stationary distributions in the non-bottleneck nodes. 

Kogan and Liptser [16] study a closed Markovian queueing network 
with an M/M/co hub, a large number N of customers (tasks) which 
at the initial time moment all distributed in the server, and k different 
M/M/l satellite nodes, assuming that the fcth satellite node operates 
as a bottleneck node. It was shown that, as N — > oo, the limiting non- 
stationary queue-length distribution in the non-bottleneck node is a 
geometric distribution with parameter depending on time. 

Abramov [1] develops the model considered in the paper of Ko- 
gan and Liptser [16], assuming that the service mechanism in satellite 
nodes is autonomous, and the sequence of intervals between service 
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completions there forms a strictly stationary and ergodic sequence of 
random variables. It is established the expression, where the limit- 
ing non-stationary queue-length distribution in non-bottleneck node in 
time t is expressed via limiting non-stationary queue-length distribution 
immediately before the last departure of a unit before time t. The 
obtained representation enables us to conclude that for any time t > 
the queue-length in the bottleneck node has the same order as that in 
the Markovian variant of network, having the same traffic intensities 
in the satellite nodes. 

Abramov [2] develops the Markovian model of Kogan and Liptser 
[16] as follows. Whereas in the model of Kogan and Liptser [16] the 
hub is an infinite-server queueing system, Abramov [2] studies the 
model where service times in the hub are generally distributed random 
variables, depending on the number of customers (tasks) residing there, 
but as in the model of Kogan and Liptser [16], the service times in the 
satellite stations are assumed to be exponentially distributed as well. 
More precisely, it is assumed the following: if immediately before a 
service of a sequential customer the queue-length at the hub is equal 
to K < N, then the probability distribution function is Gk(Kx), 
g^ 1 = / °°xdGx(^) < °o and, as N — > oo, the sequence of prob- 
ability distributions {Gn(x}} converges weakly to G(x) with g~ l = 
xdG(x) < oo, and G(0+) = 0. Along with these assumptions it is re- 
quired the stochastic order relations between two neighbor distribution 
functions Gk(Kx) and Gk+i(Kx + x). It is assumed that Gk(Kx) < 
Gk+i{Kx+x) for all x > 0. The sense of this order relation is intuitively 
clear: a rate of service time at the hub increases, as a queue-length 
increases there. Note, that this assumption is automatically implied in 
the special case of G\{x) = G^z) = ... = Gn(x) = G[x) = 1 — e~ Xx , 
leading to the network considered by Kogan and Liptser [16]. 

Studying a more general model than in the paper of Abramov [1], we 
are not going to provide a comprehensive analysis of the network as it 
is done in the three abovementioned papers of Kogan and Liptser [16] 
and Abramov [1], [2]. Namely, we are not going to study diffusion and 
fluid approximations for a bottleneck node in the corresponding cases 
of moderate and heavy usage regimes respectively (for the definition 
see e.g. Kogan and Liptser [16]). The reason for this is the following. 
During the last decades the diffusion and fluid approximations have 
been intensively studied in a large number of works related to quite 
general class of stochastic models. Although, to our best knowledge, 
the model considered here is not covered, the behavior of the bottle- 
neck client station under appropriate heavy traffic conditions remains 
the same as of the earlier models considered in the abovementioned 
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papers. In other words, the behavior of the bottleneck client station is 
expected to be described by the similar stochastic ltd equations as in 
the paper of Kogan and Liptser [16] or Abramov [1]. In the analysis 
of the multi-server stochastic network considered here, the new effects 
can be expected namely for the limiting non-stationary queue-length 
distributions in the non-bottleneck stations, and therefore, it is the 
main object for study of the present paper. 

1.3. The main result and the special cases 

Introduce the following notation, which will be used throughout the 
paper. The queue-length process in the client station j (j = 1, 2, k) 
will be denoted Qj(t). Each queue-length process Qj(t) is a function of 
the set of parameters N±, N2,—, N r , i.e. Qj(t) = Qj(t, Aq, N2, N r ). 
To avoid the complicated notation, these parameters will be always 
omitted. Thus, writing lim^v— >oo ^{Qj(t) = 1} we mean limjv^oo ¥{Qj(t, 
iVi, N 2 , N r ) = 1} or hmN^ooFiQjlt, N) = I}. (All the parameters 
Nj, j = 1,2, ...,r depend on N, and, as N — > 00, all them increase to 
infinity as well.) We hope that it does not cause a misunderstanding. 
The same note holds for the other processes appearing in the paper. 

The point processes Sj(t), j = 1, 2, k, associated with the random 
sequences £j,2, •••}, are defined as follows: 

00 

sj(t) = ^Wj,i<t}, 
1=1 

where 1(A) denotes the indicator of event A and 

l 

i=i 

For any t > introduce the process 

S*(t) = mf{s > : Sj(s) = Sj(t)}, 

having a sense as the moment of the last jump of the point process 
Sj(t) before time t. 

Theorem 1.1. Under the assumptions of the paper for j = 1,2, k— 1 
and for any t > we have: 

km F{Q j [S*(t)]=0} = l-p j (t), 
hm f p j (s)F{Q j (s) = l}ds 

N^oo Jo 
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N— »oo t „ 

^ = 0,1,..., 



lim [ t F{Q j [S*(s)]=l + l}ds, 



where 



Pj {t) = 6j [l - q(t) Y, AjA.fe], (1-1) 



fl. • - Ai 'J ai i - 1 2 r 

and J^- is the set of indexes i = 1, 2, r where Ajj > 0. 

Some special cases associated with Theorem 1.1 are given below. For 
Markovian network we have the following: 

Corollary 1.2. If the point processes Sj(t), j = 1,2, ...,k, all are 
mutually independent Poisson processes, then for all j = 1, 2, k — 1 

lim F{Q j (t) = l} = [l-p j (t)][Pj(t)}\ 

N—*oo 

1 = 0,1,2,..., 

where Pj(t) are given by (1.1). 

In the case when there is only one server station, we obtain Theorem 
3 of Abramov [1]. 

Corollary 1.3. [Abramov [1].] If i = 1 then for all j = 1,2, k — 1 
and for any t > 

lim F{Q j [S*(t)}=0} = l- Qj [l-q(t)}, 



lim /* ej [l- g (5)]P{Q J -(s) = Z}da 
= lim / t p{Q j [5;( S )]=i + l}d S , 



1 = 0,1,... . 

The following two corollaries considers the cases when the bottleneck 
and non-bottleneck client stations respectively have or does not have 
common server stations. In the first case we have 

Corollary 1.4. Assume that the client stations j and k are connected 
with the common server stations, i.e. both and pij are positive for 
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the same set of indexes i. Then for all j = 1,2, k — 1 and for any 
t > 

lim ¥{Q j [S*(t)]=0} = l-Q j [l-q(t)], 
hm f g j [l-q(s)]F{Q j (s) = l}ds 

= Jim [ t F{Q j [S*(s)]=l + l}ds, 

1 = 0,1,... . 

In the second case we have 

Corollary 1.5. If for the client stations j and k there is no common 
server station, i.e. the subset J'j f)^k = ®, then for all j = 1, 2, k — 1 
and for any t > 

hm F{Q j [S*(t)]=0} = l-g j , (1.2) 

hm [ t F{Q j (s) = l}ds 

= - hm [ t F{Q j [S*(s)]=l + l}ds, (1.3) 
1 = 0,1,... , 

i.e. limiting non-stationary queue-length distribution in that client sta- 
tion is independent of time, and therefore it coincides with the limiting 
stationary queue-length distribution. 

Finally, we have 

Corollary 1.6. If g/, = 1, then the limiting non-stationary queue- 
length distribution in all client stations j, 1 < j < k — 1, is independent 
of time and given by (1.2) and (1.3). 

1.4. Discussion of the main result on simple examples 

To discuss the main result of the paper and the corollaries we give 
a number of simple examples of network topologies of the network 
containing two server stations and four client stations. The two simple 
examples for topologies of that network have been considered above in 
Figures 1.1 and 1.2. The case of the network topology in Figure 1.1 is 
intuitively clear and can be described without any analysis by applying 
the known results on the network with one server station. 
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Let us consider the network topology in Figure 1.2. There are four 
client and two server stations, and the fourth client station is a bot- 
tleneck node. The two server stations of that network are common for 
all client stations. Therefore, according to Corollary 1.4, the limiting 
non-stationary queue-length distribution of the non-bottleneck client 
si station, illustrated in 

F 




Figure 1 .3. A network with one server station and four 
client stations 



Thus, we join two server stations to one common server station, as- 
suming that the traffic parameters in the both networks are equivalent. 
The intuitive explanation of this case is the following. As N large, all 
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outputs from server stations are close to Poisson processes. The joining 
of the processes outgoing from the server stations is close to Poisson 
process as well. Next, the input processes to the client stations are the 
thinning of the processes outgoing from the server stations, and they 
are also close to the corresponding Poisson processes. Again, the joining 
of these thinning processes corresponding to the server stations leads 
to the processes closed to Poissonian. 

Let us now consider a new network topologies of two server and four 
client stations, as it is shown in Figure 1.4. Both the first and second 
server stations have connection with three client stations. The server 
station 1 is not connected with a bottleneck node. One of connections 
of the server station 2 is the bottleneck client station. (According to 
convention we always assume that the bottleneck node is the client 
station 4.) 
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Figure 1 .4. Every of server stations is connected with 
three client stations only 



Then, according to Corollary 1.5, the limiting non-stationary queue- 
length distribution in the client station 2 is independent of time for 
any t > and coincides with the limiting stationary queue-length 
distribution as t — > oo. The client stations 1 and 3 depend on bot- 
tleneck station 4. There is only one server station connected with this 
bottleneck station, and the client stations 1, 3 and 4 are connected with 
the common server station 2. Therefore, the subnetwork consisting of 
the server station 2 and the client stations 1, 3 and 4 can be considered 
as a network with a single server station and three client stations, and 
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the limiting non-stationary queue-length distribution can be calculated 
by Corollary 1.4. The intuitive explanation for the case of the above- 
mentioned subnetwork of the server station 2 and the client station 1, 
3 and 4 is not the same as in the case of the network in Figure 1.2, 
since input rate to the client stations 1 and 3 includes both streams 
from the server stations 1 and 2 while the input stream to the client 
station 4 arrives from the server station 2 only. 

Our last example is the case, where the network can not be reduced 
to the more simple cases as it was above. Let us consider the network 
in Figure 1.5. 
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Figure 1 .5. An example of network that can not be 
decomposed to simple subnetworks 



The bottleneck node - client station 4, receives units from the both 
server stations. Every of client stations is connected only with one 
server station. Therefore, neither Corollary 1.4 nor Corollary 1.5 can 
be applied. Then, as N — > oo, the limiting non-stationary queue-length 
distributions for the client stations 1, 2 and 3 are determined from the 
main result, Theorem 1.1. 
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The paper is structured into 5 sections. Section 1 is an introduction, 
where description of the model, review of the literature, motivation, 
main result and its discussion are provided. Section 2 derives the equa- 
tions for the queue-length processes in the client sections and reduces 
the problem to the Skorokhod reflection principle. Section 3 studies 
asymptotic properties of the normalized queue-length processes in the 
client stations. It deduces a system of equations of the normalized 
queue-lengths, permitting us to describe a dynamics of the normalized 
queue-lengths in the client stations. Section 4 proves the stability of the 
queue-length process in non-bottleneck client stations, i.e. existence of 
functionals associated with the limiting non-stationary queue-length 
distributions in those client stations. The main result of this work is 
proved in Section 5. 

2. Queue-length processes in the client stations and 
reduction to the Skorokhod problem 

Consider the client station j, j = 1,2,..., A;. Recall that Qj(t) denote 
a queue-length at time t. According to the convention, Qj (0) = 0, and 
for positive time instant t > we have: 

Q J (t) = A j (t)-D J (t), (2.1) 

where Aj(i) is the arrival process to client station j and Dj(t) is the 
departure process from client station j. 

The departure process is described by the equation 

Dj(t)= [ t l{Q j (s-)>0}dS j (s) 
Jo 

= Sj(t)- f t I{Q j (s-) = 0}dS j (s), (2.2) 
Jo 

where the point process Sj(i) was defined above in Section 1.4. 

The description of the arrival process Aj(t) is the following. Let J?j 
be the set of indexes i where Ajj > 0, i = 1,2, ...,r (see also Section 
1.4). Then we have the representation 

Aj(t) = £ A hJ (t), (2.3) 

where Aij(t) denotes the arrival process from the server station % to 
the client station j. 
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In order to derive the explicit representations for the processes Aij(t) 
let us introduce the following notation. Let J?i be the set of indexes 
j where Xij > 0, and let Qij(t) denote the number of units in the 
queue at the jth client station arriving from the ith server station. 
Introduce also {^i,j, v {t)}, v = 1,2,..., Ni, a collection of independent 
Poisson processes with rate Ajj. Then we have 

ft Nl _ 
Ai,j(t) = E X {^- E ^ «}<Ki,v(*)> (2-4) 

v=i leji 

and 

Qj(t) = E QiAQ- ( 2 - 5 ) 

From (2.1), (2.2) we have the following representation for the queue- 
length process Qj(t) 

Qj(t) = Aj(t) - Sj(t) + fl{Qj{s-) = 0}dSj(t), (2.6) 

Jo 

which implies that Qj(t) is the normal reflection of the process 

Xj(t) = Aj(t) - Sj(t), X j (0) = (2.7) 

at zero. More accurately, Qj(t) is a non-negative solution of the Sko- 
rokhod problem (e.g. Skorokhod [32], Tanaka [33], Anulova and Liptser 
[3] of the normal reflection of the process Xj(t) at zero (for the de- 
tailed arguments see Kogan and Liptser [16]). According to Skorokhod 
problem 

^(t) = fl{Qj{s-) = 0}dS» = -MXj(8). (2.8) 

In the following we will use the notation 

V t (X) = -w£X(s) (2.9) 

s<t 

for any cadlag function X(t), t > 0, with X(0) = 0. Then we have 

Q j (t) = X j (t) + V t (X j ). (2.10) 

We will use also the notation 

* t (X) = X{t) + * t (X) (2.11) 

for any cadlag function X{t), t > 0, with X(0) = 0. Then (2.11) is 
rewritten as Qj(t) = &t(Xj). 
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Take into account that the processes Aij(t), Sj(t), j = 1,2, 
i G J^j, all are the semimartingales adapted with respect to filtration ^ 
given on stochastic basis F = (J^) t >o,P}. In the following the 

compensators of these processes are pointed out by hat. For example, 
Sj(t) is a compensator corresponding to the semimartingale Sj(t) in the 
Doob-Meyer decomposition (i.e. Sj(t) = Sj(t) + Mg^i)). Taking into 
account that the processes Sj(t) — Sj(t), A it j(t) — Aij(t), j = 1, 2, k, 
i £ J^-, all are the local square integrable martingales (see Liptser and 
Shiryayev [24], Chapter 18) we obtain 

X j (t) = A j (t)-S j (t) + M j (t), (2.12) 

where 

Aj(t)= ]T A id (t) (2.13) 

(see ref. (2.3)), and 

Mj(t) = [Aj(t) - Aj(t)} - [Sj{t) - Sj{t)] (2.14) 
is a local square integrable martingale. In addition to (2.12) 

Aij(t) = Xtj{Ni - ]T Qi,i(s)}ds (2.15) 



(for details see Dellacherie [9], Liptser and Shiryayev [25], theorem 
1.6.1). Introduce the random function gi j(t), the instantaneous rate 
of units arriving from the server station i to the client station j in time 
t > 



9i,j(t) = lim 



E{A id (t) - A hj (t - A)\Ni - Eie A QM) 



A^O A 
A^O A 

= \ij{Ni - (2-16) 



(2.17) 



coinciding with the integrand of (2.15). Then, the sense of 

g»,j(*) 
T,iej?i 9l,j (t) 



is the fraction of the instantaneous rate of units arriving from the 
server station i to the client station j in time t with respect to the 
instantaneous rate of units arriving to the client station j in time t. 
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For small A and t - A > let 

M itj (t)-M itj (t-A) = — [A j (t)-A j (t-A)-A j (t)+A j (t-A)\ 

l^ieJ'j 9i,j{t) 

- g^T (f] m)-S 3 (t-A)-S 3 (t)+S 3 (t-A)}. 

(2.18) 

Then 

M i , j {t)= [* 9lA *\, dM s (s) (2.19) 

is a local square integrable martingale. It is readily seen from (2.19) 
that 

its, ie^/ ^i^jShA*) 

= M,(i). (2.20) 



3. Asymptotic properties of normalized queue-length in 

client stations 

For j = 1,2,..., A;, let 

denote the normalized queue-length process, and let 

denote the associated normalization of the process Xj(t). From (2.12) 
we have 

= " ^^-(t) + m,(i), (3.3) 

where 

mj(t) = ±Mj(t) (3.4) 

is a local square integrable martingale. From (3.1) - (3.4) we obtain the 
equation 

<&(*) = jjMt) ~ ^Sj(t) + mj (t) + * t (^). (3.5) 
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Following (2.11), equation (3.5) can be rewritten in the other form 

q j (t) = * t (x j ). (3.6) 
Going back to relation (2.5) we can also write 

E i = 1 ^,-,r, (3.7) 

where 

Qi,j(t) = ^QiAt)- (3-8) 
In the following we will use the formalization 

q id (t) = *\( Xj ), (3.9) 

giving us 

* t { Xj ) = E *i{ Xj ). (3.10) 
Next, let us introduce the normalized process 

^ Jo l^ieSj 9i,j{s) 
9i,j(s) 



N Jo Ei e ^9l,j(s) 

where 



Jo y,ic*;Qu(s) 



miAt) = ^M id (t). (3.12) 



Relations (3.11), (2.15) and (2.17) yield 

VijW) = J Q X i,j{ N i ~ E QiA S )} ds 



N Jo Y.ieSj 9i,j(s 
Taking the sum over i in (3.13) we obtain 

rt 



' l* —^M— dSj^ + rmAt)- (3-13) 
Jo y,ie*; gu(s) 



X 



: (*) = 4/ E *ij{ N * - E QiA*)}*° 

J0 iejtj leji 



__S 3 {t)+m 3 {t). (3.14) 
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Let us now study the solution of equation (3.14) as A — > oo. Notice 
first that 

P- lim ^=Sj(t) = fid. (3.15) 

(P— lim denotes the limit in probability.) This limiting relation is proved 
in Abramov [1], p. 30-31. Here we briefly recall the main steps of that 
proof. 

We have 

±S j (t) = ±[S j (t)-S j (t)] + ±S j (t) 

= h(N) + I 2 (N). (3.16) 

The first term of the right-hand side h(N) is a local square integrable 
martingale. As A — > oo this term vanishes in probability. The proof of 
that is established by application of the Lenglart-Rebolledo inequality 
(see also Konstantopoulos et al [19]). In view of (3.16) this means 

P - lim l^-(t) = P - lim I 2 {N). (3.17) 

N-*oo iv N^oo 

Hence, (3.15) will be proved if we prove that 

N^oo iv 

Limiting relation (3.18) in turn follows by application of the following 
lemma of Krichagina et al [20] . 

Lemma 3.1. Let g/ N = (,&? t N ) t > , N > 1, be a sequence of increasing 
right continuous random processes with srf§ = 0. Let 

= inf{s : £/ s N >t}, t> 0, 

where inf(0) = oo. If, for every t taken from dense set 5? C R+, SSf — > 
at as A — > oo (a > 0), then, as A — > oo, 



sup 

t<T 



1 a 







in probability for each T > 0. 



Note that analogously to (3.17) and (3.18) we have 



and therefore 



' " a!™ ^ W = P " v lim 1x7^)' < 3 - 19 ) 

N^oo iv N— >oo iv 



lim -j-A,-(t) = P - lim -[-A,-(t). (3.20) 

N^oo iv iV— >oo iv 
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Next, applying the Lenglart-Rebolledo inequality, for any positive 8 
we obtain 

P{ sup \mj(t)\ > 5} 

1 0<s<t 



< P{ sup [Aj(s) + Sj(s)] - [Aj(8) + Sj(s)} > 6n\ 

1 0<s<t 



<-+F{A j (t) + S j (t)>sN 2 } 



<^ + F{S 3 (t)>eN 2 -t^2^m, 



(3.21) 



and because of arbitrariness of e > 0, rrijit) vanishes in probability as 
N — > 00. Analogously, it is not difficult to conclude that, as N — > 00, 
also rrii : j(t) vanishes in probability. 
Next, let 



and 



Then we have 



lim xJt) = x*(t), 



lim Xij(t) = x*At). 



(3.22) 
(3.23) 



ds 



- P- lim 



1 



9i,j(s) 



and taking the sum over i in view of (3.15) we obtain 



dSj(s), (3.24) 



x*(t) 



a, 



]T K(xt)]ds + H t. (3.25) 



The solution of system (3.24), (3.25) is unique since because of the 
Lipschitz conditions 



and 



su P |$ t po-$ t (y)| < 2su P |x t -y t | 

t<T t<T 



sup \S>\(X) - $l(Y)\ < 2sup \a> t (x) - * t (y)\ 

t<T t<T 

<4sup\X t -Y t \. 

t<T 



(3.26) 



(3.27) 
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For the proof of Lipschitz condition (3.26) see Kogan and Liptser [16]. 
In turn, the proof of (3.27) follows easily from (3.10) and the triangle 
inequality. 

Before solving the system (3.24) and (3.25) let us first establish some 
properties of these equations. From (3.25) we obtain 



QjHj 



1 



^3 ie^jia^ 



Jo 



Let us now consider the system of equations 



(3.28) 



X 3 



rt _ k , 

(t) = / gjfij 1 - V $ B (x*) ds + ^t, 



(3.29) 



i = 1,2, 

The unique solution of the system (3.29) is 



x£(t)=g(t) = (l--)(l-e-™**), 



j = l,2,...,fc-l. 



(3.30) 
(3.31) 



Then considering the sequence of processes Xj(t) = Xj(N,t) satisfying 
the system of equation 



1 ('^ ^ 



one can conclude the following. First, 

Xj(t)<Xj(t), j = 1, 2, k, 



(3.32) 



(3.33) 



where Xj(t) are given by (3.14) (see arguments in ref. (3.28)). Second, 
following Abramov [1], Lemma 2, for any fixed t > and e > we have 



lim P\ sup \xj(s) — x*(s)\ > e \ = 0, 

N^oo L s<t ' 



(3.34) 
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j = 1,2,..., A;. 

From (3.34) and Lipschitz condition (3.26) we obtain 
lim P{ sup$ s (x,) > e) = 0, 

j = l,2,...,fc-l, 



25 



(3.35) 



and 



lim P{sup|$ s (x fc ) - x k (s)\ > e\ = 0. 



It follows from (3.35) and (3.36) that 

<£ t (x*) = 0, j = l,2,...,fc-l, 

and 



(3.36) 
(3.37) 

$ t (x* k )=q(t), (3.38) 

where q(t) is defined above in ref. (3.30) and in Section 1.4. Then, from 
Lipschitz condition (3.27) applied to (3.25), along with (3.37) and (3.38) 
we obtain 

$ t (x*) = 0, j = l,2,...,fc-l, (3.39) 

and 

**(*£)=?(*)■ (3.40) 

Substituting (3.39) for (3.24) and (3.25) we now have the following 
system (j = 1, 2, k; i = 1, 2, r) 



- P- lim 



a, - $i(4) 



d.s 



I/' 

Wo 



, _ , dSJs), (3.41) 



.r • 



(*) = / E a m h _ ^(^l ds _ ^ L 

Jo frit. L J 



Let us now find the term 

P- lim 1 f iiM d sj s ) 

of (3.41) (j = 1, 2, k). For this purpose let us find 

P- lim 

T,ie,Si 9l,j{t) 



(3.42) 



(3.43) 



(3.44) 
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From the initial condition 



- J™ 4f 9i,k(°) = \k&i, (3.45) 



and (3.39), (3.40) we have 



- £m -j- = ^[1 - ?(*)]■ (3.46) 



Then from (3.45) and (3.46) we obtain 



Jim 4 9i,k{t) = Xi,k®i[l - q(t)], (3.47) 



together with 



q(t). (3.48) 



£>fc 

Thus, for any t > 

P _ i im ghi^j = (3.49) 

JV - >0 °E/6^fl , J,j(*) £fc 

and for the term of (3.43) under j = k we have 

P - lim 1 /' _ ^ fc(s) - d &(«) = (3.50) 

In the following we will use the notation 

0y = ^A J = l,2,...,fc (3.51) 
(see also Section 1.4), and then limiting relation (3.50) is rewritten as 

P " a!™ Tr f v d ^' (s) = 0i ^ kL (3 ' 52) 

w^oo TV Jo LieSj giM s ) 

Now, let us consider the case j ^ k. Then we have the initial 
condition 

^1^(0) = ^, (3.53) 

and 

P " J im AT ^ = ^ Xi >i ai 
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[i - ?(«)] E A 



From (3.53) and (3.54) we obtain 



(3.54) 



(3.55) 



where Jjj = 1 if i € J^jCl^k, and ijj = otherwise. Thus, for any 
t > 



P- lim 



X iijai {l - -q(t)}} 



N ^°° 9l,j(t) Eie,s 3 - - q(t)]} ' 

and for the term of (3.43) for j = 1, 2, fc-lwe obtain 

1 /"* 



(3.56) 



— lim 



n-ZoNJq EieSi 9l,j(s) 



= P- lim 



AjjOj{l - - g(s)]} 



Wo 



dS,(s) 



lim 



Xijaijl - - q(t)}} 



Xijaijl - Ijjjl - q(t)]} 
T.izjj Azj«z{1 - - q(t)]} 
X i:j a>i{l - - q(s)}} 



Ej e ^ Ajjai{l - - q{t)}} 



- [ s d 
Jo 



]} 



= ^ L 

Jo 



Xijaijl - Ijjjl - q(s)}} 
E/g^, \jOn{l - h,j[l - q(s)]} 



ds. 



(3.57) 



In view of (3.52), (3.57) and (3.48), (3.51) system of equations (3.41) 
is rewritten as 



A 



(3.58) 



- Pi,kq(t) 



ds 



X ljai {l-I hl [l- q (s)]} 
o £, 6- * Ajjaj{l - - g(s)]} 



ds, (3.59) 
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j = l,2,...,fc-l. 
From (3.42), (3.58) and (3.59) we obtain the following solution: 

= 0i,kq{t), (3.60) 

x* -it) - A- a t -a- C hiMLiML^M ds 

-XijdiPik [ q(s)ds, (3.61) 
Jo 

j = l,2,...,fe-l. 
From (3.60) and (3.61) we obtain the final solution of the system: 

x* k {t) = q(t), (3.62) 



and 



](t) = (QjLlj ~Hj)t 



^i,j a i/3i,k j q(s)ds, (3.63) 



j = l,2,...,fc-l. 
Our next step is to prove the following 
Lemma 3.2. For any fixed t > and e > 

lim sup |xo(s) — x*;(s)\ > e \ =0, 
J = 1) 2, k. 

Proof. To prove this lemma only we have to show that the quadratic 
characteristics of the square integrable local martingales rrij(t), j = 
1, 2, k, vanishes in probability, i.e. for every e > 

lim F{(m j ) t >e} = 0, (3.64) 

N— +oo 

j = l,2,...,k 

(see Kogan and Liptser [16], Lemma 6.1 and Abramov [1], Lemma 2). 
Since 

(Mj) t < Aj(t) + Sj(t) 



<tEMi + SjW. (3-65) 



Star_3_3.tex; 1/02/2008; 23:16; p. 28 



Closed queueing network with two types of node 29 

then taking into account (3.15) and 

K) t <*Et + p^(t) (3.66) 

we obtain the desired statement of Lemma 3.2. The lemma is proved. 
Applying Liptschitz conditions (3.26), (3.27), for any e > we have 
lim P{supo.-(s) > e} = 0, (3.67) 

N^oo s<t 



and 



j = l,2,...,fc-l, 



lim F{sup\q k (s)-xt(s)\>s} = 0. (3.68) 



4. A stability of the queue-length processes in the client 

stations 

Now, let us study a question on stability, i.e. existence of the limiting 
generalized functions of the non-stationary probabilities 



lim /"*P{Q,-(a) = l}ds, 1 = 0,1,... (4.1) 



m / 

N- 

for all t > at the client stations j = 1, 2, k — 1, satisfying 

oo rt 



* rt 

lim V / P{Q,(s) = l}ds = t. 



The existence of the limiting generalized functions does not mean 
existence of the limiting non-stationary probabilities 

hm ¥{Q j (s) = l}, 1 = 0,1,... (4.2) 

The proof of the lemma below is based on the same idea that the 
corresponding proof in Abramov [1] and partially repeats that proof. 
However, there is a place in the proof of stability in Abramov [1] that 
should be reconsidered and improved, and the proof given below is 
doing that. Furthermore, the fact, that there are several server sta- 
tions with different behavior of the queue-lengths, adds a number of 
significant features as well. 
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Lemma 4.1. Under the assumptions given in the paper for all j = 
1,2, ...,k — 1 there exist the stationary queue-length processes Qj(s), 
j = 1, 2, k — 1, satisfying the inequalities 



liminf F{Qj(t) = 1} < F{Q*(s) = 1} < limsupP{Q,(i) = 1} 

1 = 0,1,... 



Proof. To prove this lemma let us denote the queue-length process in 
the server station i by Ej(i). As earlier, J*i denote a set of indexes j 



where \j > 0. We have 



Ei(t) = Ni - ^ Q i:l (t), i = l,2,...,r. (4.3) 

Normalization of (4.3) yields 

lim i-Ei(i) = on - » = 1. 2, r. (4.4) 

N ilSi 

Then, according to (3.67), (3.68) and (3.62), (3.63) we have the follow- 
ing two types of nodes. If i does not belong to then 

P- lim ls i (t) = a i , (4.5) 

N-^oo iV 

for any i > 0, otherwise, if % € then for all t > 

P- lim ^Ei(t) < «i. (4.6) 
More exactly, in the last case 

P - lim i-Eitt) = Qi [l - ?(*)&,*]■ (4-7) 

N^oo iV 

The relation (4.4) means that 

lim P{ sup -Ei(s) < ai} = 1, (4.8) 
i= 1,2,. .,r. 

Prove that 

Pf lim sup[Aj(s) - Sj(s)] < oo} = 1, (4.9) 
i = l,2,...,fc-l. 
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Indeed, it follows from (4.8) that Aj(t) < TTj(t) where is a Poisson 
process with parameter J2ie.j?j given on the same probability 

space as the process Aj(t). Therefore the problem is reduced to prove 

Pf lim sup[7r,(s) - Sj(s)] < 00} = 1, (4.10) 
j = 1,2, - 1. 

Obviously, that P-a.s. 

lim ^(t)-Sj(t) = _ (4 n) 

Therefore, 

lim [ir j (t)-S j (t)] = -oo, (4.12) 

iV^oo 

and (4.10), (4.9) follow by the fact that both iTj(t) and Sj(t) are cadlag 
functions. Next, let Qj(t) = iTj(t) — Dj(t) where Dj(t) is a func- 
tion defined in (2.1) and (2.3). According to the Skorokhod reflection 
principle 

Qj(t) = *j(t) - Sj(t) - inf fa® - Sj(t)]. (4.13) 

s<t 

Because of the strict stationarity and ergodicity of increments of the 
process TTj(t) — Sj(t), from (4.13) we obtain 

Qj(t) = SUp [(TTjit) - Sj(t)) - (TTj(s) - Sj(s))}, (4.14) 
s<t 

and in addition 

SUp [(vT,(t) - Sj(t)) ~ (7T,( S ) - S»)]=SU P fa(8) ~ Sj(8)]. (4.15) 

s<t s<t 

Thus we have 

Qiit^sapfaW-Sjis)]. (4.16) 

s<t 

Taking into account that Aj(t) < Ttj(t) we obtain 

lim inf F{Qj(t) = 1} > P{Q,-(t) = 1} 

= lim P{sup[7ri(a)-Si(s)] = I}. (4.17) 
Next, let us introduce a Poisson process Hj{z) with parameter 

KjNi[l - p itk q(t)] (4.18) 
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Assuming that both processes Aj(z) and Hj(z) are given on the same 
probability space we have Aj(z) > Hj(z) for all z > 0, and because of 



then analogously to (4.17) we have the following 

limsupP{Qj(t) =l}< lim P{sup [Uj(s) - Sj(s)] = I}. (4.20) 

N^oo N^oo s < t 

Inequalities (4.17) and (4.20) together with the results of convergence in 
probability (see ref. (3.67), (3.68) and Lemma 3.2) allow us to conclude 
that there exists a stationary process Qj(t), and for some a(t), < 
a(t) < 1, we have 



and the lemma is therefore proved. 

Notice, that existence of some stationary process Qj(t) does not 
mean that there exist limiting non-stationary queue-length distribu- 
tions (4.2). However, then there exists the limiting generalized queue- 
length distributions (4.1). Notice also that in the case when Sj(i), 
j = 1, 2, k, are Poisson processes, the limiting non-stationary queue- 
length distributions (4.2) do exist and coincide with the distribution of 
the processes Qj (t) . The existence of limiting non-stationary distribu- 
tions in the last case follows from the Chapman-Kolmogorov equations, 
which can be written in explicit form. 



5. The proof of the main result and special cases 

We start from the proof of the main result. 

Proof of Theorem 1.1. The proof of this theorem is analogous to 
the corresponding proof of Theorem 3 of Abramov [1]. Therefore we 
pay more attention to the new features where detailed explanation is 
necessary. 

First, we have the representation: 




(4.19) 



F{Q*(t) =l} = a(t)liminfP{Q,(t) = 1} 

+ [1 - a{t)\ limsupP{Qj(t) = /}, (4.21) 



N^oo 
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m / 

N- 

1 = 0,1,.., 



lim [ t F{Q j [S*(s)]=l}ds, (5.1) 



where S*(s) is introduced in Section 1.4. (For the proof of (5.1) see 
Appendix A.) 

Then, introducing 

A* j (t) = M{8>0:A j (s) = A j (t)}, (5.2) 

j = l,2,...,k-l 
we have the representation analogous to (5.1) 

lim L— -E f t I{Q j (s-) = l}dA j (s) 

N ~' QO LieJPj X i,3 N i JO 

hm [ t F{Q j [A*(s)]=l}ds, (5.3) 



1 = 0,1,. 



(The proof of (5.3) is completely analogous to the proof of (5.1) given 
in Appendix A.) 

Next, for all I = 1,2, j = 1, 2, .., k — 1 and t > we have the 
relation connecting the number of up- and down-crossings: 

Aj(t) Si(t) 

]T HQjir^-) = z - 1} = ]T HQjKu-) = i} 

U=l 11=1 

+ I{Qj(t)>l}, (5.4) 

where r^i, Tj^, ■■■ are the moments of arrival to node j, and cr^i, 0^2, ■■■ 
are the moments of departure from node j. 
It follows from (5.1), (5.3) and (5.4) that 



lim 1^ I{Q j (s-)=l-l}dA j (s) 



rt 

n'-^'qo N Jo 



= lim 1 f t I{Q J (s-) = l}dS J (s), (5.5) 
1 = 1,2,... . 

Taking into account (3.20) the left-hand side of (5.5) can be rewritten 
lim -j-E f t I{Q j (8-) = l-l}dA j (s) 

J^oo iV Jo 



as 

N 
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lim 



i-iydAjis). 



(5.6) 



(The technical details of the proof of that see in Appendix B.) 

From (2.13), (2.15) and asymptotic results of Section 3 (see (3.39), 
(3.40) and (3.48) together with notation (3.51)) we obtain 



N—>co iv L '—• * 



(5.7) 



j = l,2,..,fc-l. 
Therefore, substituting (5.7) for (5.6) we obtain 

lim 1 f t I{Q j (s-)=l-l}dA j (s) 

N— >oo iV JO 

= QjHj J' F{Qj(s) = I - 1} [l - g(s) ]T 

In turn, substituting (5.8) for (5.6) and (5.5) we obtain 
lim 1 f t I{Q j ( 8 -) = l}dS j (s) 

N—kx) iv Jo 



ds. 



(5.f 



ds. 



(5.9) 



= W / P{Q» = Z - 1} [l - q(s) 

Then, keeping in mind (5.1) proves the theorem. The theorem is proved. 

Let us now prove the special cases of this theorem. 
Proof of Corollary 1.2. Notice that 

hm i-E f t I{Q j (8-) = l}dS j ( 8 ) 

N-^oo iv Jo 



= lim 1e f t I{Q j (s-)=l}dS j (8), 

N—too iv Jo 

1 = 0,1,... . 



(5.10) 



(For the proof see Appendix B by replacing there the processes A/(t) 
and Aj(t) with the corresponding processes Sj(t) and Sj(t).) Then 
limiting relation (5.1) can be rewritten as 



lim - , 

jV-+oo [AjJM Jo 



E / I{Qj(s-) = l}dSj(s) 
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m / 

N- 

1 = 0,1,... . 

According to assumption Sj(t) is the Poisson process with rate fijN, 
and therefore, Sj(t) = [ijNt. Then, from (5.11) we obtain 

lim ¥{Qj[S*(t)} = l} = lim ¥{Qj(t) = I}, (5.12) 

N—+00 N^oo 

1 = 0,1,... , 

and the result follows. 



Proof of Corollary 1.3. Indeed, in this case (3± t j = f3\^ = 1 for all 

j = 1, 2, k — 1, and the result follows from Theorem 1.1. 

Proof of Corollary 1.4. Indeed, in this case both f}^ and are 
positive for the same set of indexes i and therefore 

E Mi = i> ( 5 - 13 ) 

its, n A 

and the result follows. 



Proof of Corollary 1.5. The proof follows immediately from Theorem 
1.1. 



Proof of Corollary 1.6. Indeed, when ft = 1 we obtain q(t) = 0, and 
the result follows from Theorem 1.1. 



APPENDIX A 

Proof of relation (5.1). Take a small interval tyf = (it, u+du]. Denote 

m = min{n : u^ n G } 

ri2 = max{n : aj <n G ^}, 

where the notation for (7j n is given in Section 1.4. Recall that <7j in = 
X)iLi<v/,j, where {£j,i}i>i are the increments associated with the point 
process Sj(t). Then, according to Lemma 3.1 we obtain that N~ 1 [Sj(u+ 

du) — Sj(u)]^fijdu. 

Let us now apply the Cesaro theorem (e.g. Polya and Szego [30]): if a 
sequence {a n } converges to S, then also a sequence Sjy = N' 1 J2iLi a i 
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converges to S. Applying this result and the Lebesgue theorem on 
dominated convergence we obtain: 

lim F{Qj(S*{u + du) = I) 

N^oo Sj(u + du) - Sj(u) J J ' 

= lim — E V P{Q 7 (cj 7 i -) = /} 

• J i=n\ 



n\ = a±, n 2 = a.2 



n-i = cti,ri2 = a 2 



xP{ni = ai,n 2 = a 2 } 

-^j^m-u £ «{.E'Wi('«-)-o 

ai<«2 i=ai 

xP{ni = cti,n 2 = a 2 } 
= lim — — — E V I{Q 7 -(a,-i-) = Z} 

' J i=n\ 

= T- J im AzmiQiW-) = l}[Sj(u + dn) - 
aw N—>co [ijiv 

where -u* G Relation (5.1) follows. 

APPENDIX B 
Proof of relation (5.6). Rewrite the left-hand side of (5.6) as 

lim 1e f t I{Q j (s-) = l-l}dA j (s) 

TV^oo iV JO 

= lim 1e fl{Qj{8-) = I - ljdAjis) 

N^co 1\ Jo 

+ ^^j*HQj(s-) = l-l}dlA J (s)-A J (s)] (BA) 
It follows from (3.20) that, as N — > oo, the term 

±[ Aj (t) - Mt)} (B.2) 
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vanishes in probability, and also 

E f t I{Q j (s-) = l-l}d[A j (s)-A j (s)} 
Jo 

<|E(^-(t)-^(i))|. (B.3) 

Therefore, as N — > oo, from (B.2), (B.3) and the Lebesgue theorem on 
dominated convergence we obtain 

JV lhn oo^ E H 1 ^-) = I ~ l}d[^(s) - Ms)} = 0, 
and (5.6) follows. 
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